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Abstract 

This article is concerned with the design and analysis of discrete time Feynman-Kac particle 
integration models with geometric interacting jump processes. We analyze two general types of 
model, corresponding to whether the reference process is in continuous or discrete time. For the 
former, we consider discrete generation particle models defined by arbitrarily fine time mesh ap- 
proximations of the Feynman-Kac models with continuous time path integrals. For the latter, we 
assume that the discrete process is observed at integer times and we design new approximation 
models with geometric interacting jumps in terms of a sequence of intermediate time steps between 
the integers. In both situations, we provide non asymptotic bias and variance theorems w.r.t. the 
time step and the size of the system, yielding what appear to be the first results of this type for this 
class of Feynman-Kac particle integration models. We also discuss uniform convergence estimates 
w.r.t. the time horizon. Our approach is based on an original semigroup analysis with first order 
decompositions of the fluctuation errors. 
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1 Introduction 

Feynman-Kac formulae are central path integration mathematical models in physics and probability 
theory. More precisely, these models and their interacting particle interpretations have come to play 
a significant role in applied probability, numerical physics, Bayesian statistics, probabilistic machine 
learning, and engineering sciences. Applications of these particle integration techniques are increasingly 
used to solve a variety of complex problems in nonlinear filtering, data assimilation, rare event sampling, 
hidden Markov chain parameter estimation, stochastic control and financial mathematics. A detailed 
account of these functional models and their application domains can be found in the series of research 
books [31 H21 EU [271 El and, more recently, in H [HI [26] . 
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In computational physics, these techniques are used for free energy computations, specifically in 
estimating ground states of Schrodinger operators. In this context, these particle models are often 
referred as quantum or diffusion Monte Carlo methods [TJ [2] [7] [3U] . We also refer the reader to the 
series of articles [TT1 1231 1301 HT1 136] . 

In advanced signal processing, they are known as particle filters or sequential Monte Carlo methods, 
and were introduced in three independent works in the 90's [9] [32] [37]. These stochastic particle 
algorithms are now routinely used to compute sequentially the flow of conditional distributions of the 
random states of a signal process given some noisy and partial observations [3] [TOj [12] (2TJ [27J [28] 
[35] [38] . Feynman-Kac formulae and their particle interpretations are also commonly used in financial 
mathematics to model option prices, futures prices and sensitivity measures, and in insurance and risk 
models [4j [5] [33], [42] [44] [43] . They are used in rare event analysis to model conditional distributions of 
stochastic processes evolving in a rare event regime [6] [5] [20]. 

This article presents geometric interacting jump particle approximations of Feynman-Kac path 
integrals. It also contains theoretical results related to the practical implementation of these particle 
algorithms for both discrete and continuous time integration problems. A key result is the presentation 
of connections between the interacting jump particle interpretations of the continuous time models and 
their discrete time generation versions. This is motivated by the fact that while the continuous time 
nature of these models is fundamental to describing certain phenomena, the practical implementation 
of these models on a computer requires a judicious choice of time discretization. Conversely, as shown 
in section 2.1 in [25] . a discrete time Feynman-Kac model can be encapsulated within a continuous 
time framework by considering stochastic processes only varying on integer times. Continuous time 
Feynman-Kac particle models are based on exponential interacting jumps |15[ [24] [2T] [30] l31~] [29] 146] . 
while their discrete time versions are based on geometric type jumps |10 [ I16 [ [T9]. From a computational 
perspective, the exponential type interacting jumps thus need to be approximated by geometric type 
jumps. Incidentally, some of these geometric type interacting jump particle algorithms are better suited 
to implementation in a parallel computing environment (see section [5T3]) . 

Surprisingly, little attention has been paid to analyze the connections between exponential and 
geometric type jump particle models. There are references dealing with these two models separately [8] 
fTT] [T8] [22] [25] [24] 146] . but none provide a convergence analysis between the two. In this paper we 
initiate this study with a non asymptotic bias and variance analysis w.r.t. the time step parameter 
and the size of the particle population scheme. Special attention is paid to the stochastic modeling 
of these interacting jump processes, and to a stochastic perturbation analysis of these particle models 
w.r.t. local sampling random fields. 

We conclude this section with basic notation used in the article. We let B{,(E) be the Banach 
space of all bounded Borel functions / on some PolisnU state space E equipped with a Borel u-field £, 
equipped with the uniform norm ||/|| = sup xg£ ; We denote by osc(/) := sup^ \f(%) — f(y)\ the 

oscillation of a function / G B{,(E). We let = J f(x)fi(dx) be the Lebesgue integral of a function 
/ G Bb(E) with respect to a finite signed measure fi on E. We also equip the set M(E) of finite 
signed measures fi with the total variation norm \\fJ,\\tv = SU P where the supremum is taken 

over all functions / G Bb(E) with osc(/) < 1. We let V{E) C M(E) be the subset of all probability 
measures. We recall that any bounded integral operator Q on E is an operator Q from Bb(E) into 
itself defined by Q(f)(x) = J Q(x,dy)f(y), for some measure Q(x, .), indexed by x G E, and we set 

1 i.e. homeomorphic to a complete separable metric space 
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||Q||tv = su Pa;g_E IIQC 37 ) Olltv These operators generate a dual operator fi i— > /xQ on the set of finite 
signed measures defined by (/iQ)(/) = fj,(Q(f)). A Markov kernel is a positive and bounded integral 
operator Q s.t. Q(l) = 1. The Dobrushin contraction coefficient of a Markov kernel Q is defined by 
/3(Q) := suposc(Q(/)), where the supremum is taken over all functions / G Bb{E) s.t. osc(/) < 1. 
Given some positive potential function G on £7, we denote by *$>q the Boltzmann-Gibbs transformation 
At G 7>(£) k> tf G (/z) G P(£) defined by ¥ g (m)(/) = v{fG)/(i{G). 



2 Description of the models 
2.1 Feynman-Kac models 

We consider an E 1 - valued Markov process Xt, t £ M + = [0, oo[ defined on a standard filtered probability 
space (Q, T = (J : t)t£R + , P)- The set Q = _D(K + , E) represents the space of cadlag paths equipped with 
the Skorokhod topology which turn it into a Polish space. A point oj G represents a sample path 
of the canonical process X t {oj) = oj t . We also let J 7 ^ = a(X s , s < t) and P be the sigma-field 
and probability measure of the process (Xt)teR+- Finally, we also consider the P- augment at ion Tt of 
J-^ so that the resulting filtration satisfies the usual conditions of right continuity and completion 
by P- negligible sets (see for instance |36l I45| . and the references therein). We also consider a time 
inhomogeneous bounded Borel function Vt on E. 

We let Qt and At be the Feynman-Kac measures on fit '■= D([0, t], E) defined for any bounded 
measurable function / on fit, by the following formulae 

Qt(f) := A*(/)/A t (l) with A t (/) = E f/(* [0jt] ) e W U*V s (X s )ds^ (1) 



and we let i>t and fit, respectively, be the t- marginals of At and Qt. 

We consider the mesh sequence t^ = k/m, k > 0, with time step h = t n — t n -\ = 1/m associated 
with some integer m > 1, and we let Qt!T and A^ be the Feynman-Kac measures on Qt n defined for 
any bounded measurable function / on f2+ , by the following formulae 



\ 0<p<n J 

We also denote by vf 1 ^ and /4 , respectively, the i n -marginal of Aj"^ and Q^ ■ 

• Case (D) : We have Xt = Xui and Vt = logG^tj, where X n , n G N is an E-valued Markov 
chain, and G n are Borel positive functions s.t. logG n is bounded. 

In this case, the marginal v n = j n and fj, n = rj n of the Feynman-Kac measures of At and Qt on 
integer times t = n are given for any / G Bb(E) by the formula 

r?n(/) = 7n(/)/7n(l) with 7n (/) := E I f(X n ) l[G p (X p )\. (3) 

\ 0<p<n / 
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• Case (C) : The process Xt is a continuous time Markov process with infinitesimal generators 
Lt : D(L) — > D(L) defined on some common domain of functions D(L), and V G C 1 (M+, D(L)). 
The set D(L) is a sub-algebra of the Banach space B{,(E) generating the Borel a-field £, and for 
any measurable function IA : t G IR + i— > Ut G *D{L) the Feynman-Kac semigroup Q S) t, s < t, 
defined by 

Q.,t(J)(x) = E (f(X t ) exp (J U r (X r )dr) \ X s = x^j 

leaves D(L) invariant; that is we have that Q s j{D(L)) C D(L). For any s < t, the mappings 
r G [0, s] i — ^ L r (Q S)t {f) 2 ) and r G [0, s] i-> L 2 (Q S) t(f) 2 ) G C 1 ([0, s],D(L)), and their norm as well 
the norm of the first order derivatives only depend on (X s ) s < t and on the norms of the functions 
(JA s ) s <t and their derivatives. 

The regularity conditions stated in (C) correspond to time inhomogeneous versions of those introduced 
in |24| . They hold for pure jump processes with bounded jump rates with D(L) = Bb(E), or for 
Euclidean diffusions on E = M. d with regular and Lipschitz coefficients by taking D(L) as the set of C°°- 
functions with derivatives decreasing at infinity faster that any polynomial function. These regularity 
conditions allow the use of most of the principal theorems of stochastic differential calculus, e.g. the 
"carre du champ", or square field, operator that characterizes the predictable quadratic variations of 
the martingales that appear in Ito's formulae. These regularity conditions can probably be relaxed 
using the extended setup developed in |21| . 

We have already mentioned that the particle interpretations associated with the continuous time 
models (p} are defined in terms of interacting jump particle systems |21l [22] [24} I25| . The implemen- 
tation of these continuous time particle algorithms is clearly impractical and we therefore resort to 
the geometric interacting processes associated with the m-approximation models defined in ([2]). These 
discrete generation interacting jumps models provide new and different types of adaptive resampling 
procedures, which differ from those discussed in the articles |12[ I13j. and the references therein. 

2.2 Mean field particle models 

In this section, we provide a brief description of the geometric type interacting jump particle models 
associated with the m-approximation Feynman-Kac model defined in ([2]). First, if we define 

M tn ,t n+1 (x, dy) = P (X tn+1 G dy \ X tn = x) and Q tn = exp (V tn /m), 
then it is well known that satisfies the following evolution equation 

»tl=*Qt n (»t ) )Mt n ,t n+1 . (4) 

Further details on the derivation of these evolution equations can be found in |10[ [21] [16] . The particle 
interpretation of this model depends on the interpretation of the Boltzmann-Gibbs transformation in 
terms of a Markov transport equation 

^QtM=^t n ^ (5) 

for some Markov transitions St n}tl , that depend on the time parameter t n and on the measure fi. The 
choice of these Markov operators is not unique; we refer to |10) for a more thorough discussion of 



4 



these models. In this article, we consider an abstract general model, and illustrate our study with the 
following three classes of models. 

• Case 1 : We have Vt = —hit-, f° r some non negative and bounded function tit- In this situation, 
(|5|) is satisfied by the Markov transition 

S tn ,,(x,dy) := e^* 5 x {dy) + (l - ^"W/j ^ e -u tJm ^)(dy). 

• Case 2 : The function Vt is non negative. In this situation, ([5]) is satisfied by the Markov 
transition 

StnA^y) := J^kj™) 6x{dy) ^( e vl„/m) ) *( e V t nM-l)(/^)(^)- 

• Case 3: The Markov transport equation ([5]) is satisfied by the Markov transition 

S tn ^(x,dy) := (1 - a tn ^{x)) 5 x {dy) + a tn ^(x) *( e v tn /m_ e v t „M/m) (ji)(dy) 

with the rejection rate a tn ^(x) := yt (( e Vt «/ m - e Vi "^/ m ) + ) //i (e Vt «/ m ) £ [0, 1] 
In these three cases we have the following first order expansion 

S tnil i = Id+ —L tn ^+ ^ Rt»,n ( 6 ) 



R 



< OO, 



tv 



with some jump type generator Lt n « and some integral operator R ( m ) s.t. sup 

where the supremum is taken over all m > 1 and /x £ V(E). The jump generators „ corresponding 
to the three cases presented above are described respectively in (|12p . (|13p . and (| 14j) . The proofs of 
these expansions is rather elementary, and they are housed in the appendix, on page 1371 
In addition, whenever ([5]) is satisfied, we have the evolution equation 

4™+! = ^r )/C „+i u ^ with the Markov kernels K, tnitn+lttl = S tn!fl M tn ,t n+1 . (7) 

The mean field iV-particle model ^ n := (£j n )i<j<7v associated with the evolution equation (J7J) is a 
Markov process in E N with elementary transitions given by 



P (*w e cfc | 6») = II ^(4-^) with a*£ = ^ £ (8) 

l<i<JV l<i<Ar 

where dx = dx 1 . . . dx stands for an infinitesimal neighborhood of the point x = (x l )i<i<N £ E N . 
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3 Statement of the main results 

Our first main result relates the Feynman-Kac models ([TJ and their m-approximation measures ([2]) in 
case (D) and (C). 

Theorem 3.1 In case (D), we have 

v n m) = v n = In and = (J, n = r) n 

with the Feynman-Kac measures -y n and r\ n defined in ([3^. 
In case (C), we have the first order decomposition 



1 



=A tn + -r m , tn and = Q tn + - r m ,t 



with some remainder signed measures r m ,t„ , r mytn s.t. sup m >! [||?"m,tj| tv V ||r m ,t n || tv ] < 



oo. 



The proof of the theorem is rather technical and it is postponed to the appendix. 
The first assertion of theorem 13.11 allows us to turn a discrete time Feynman-Kac model ([3]) into a 
continuous time model ([!]). To be more precise, we have that uj: = v\ '■ Qtl with the Feynman-Kac 



,( m ) _ ,,M,o( m ) 

semigroup 



x 



Q^ n {f){x) := E f(X tn ) J] e V ^/™ \ X tp 

\ p<q<n 

in case (D), for integer times (t p , t n ) = (km, nm), with k < n, we also have that 7 n = ^fkQk,n with the 
Feynman-Kac semigroup 

Q fc) „(/)(x) := E I f(X n ) H diXt) \X k = x\ = Q { $(f)(x). 

\ k<l<n J 

Thus, the normalized Markov kernels PL\^ (/) := Qk^(f)/Qk"n(^) a ^ so coincide with the Markov 
kernels Pk, n (f) '■= Qk,n(f)/Qk,n(^)- 111 addition, for any k > and r < m, we also have the semigroup 
formulae 

Qtn\f)(-) = Gk(xp m Qtl /m Jf)(-) -d pW = Pg> /mtn = P k , n . (9) 

We prove the l.h.s. assertion using the fact that for any n > and any p = km + r, with k > 
and r < m, we have t p = k + r/m and 

OSS (/)(*) = G fc (xr/ m xEl/(^ nm ) I] e V4, |Af fc+r/m = x 

\ k+r/m<t q <n 

For a Feynman-Kac measure ([I]) associated with a continuous diffusion style process Xf, it is 
important to observe that the l.h.s. measure in the m-approximation model ([2]), as defined on a time 
mesh sequence, can be thought of as a time discretization of the exponential path integrals in the 
continuous time model ([T]). Nevertheless, the elementary Markov transitions of the Markov chain 
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{Xt n )n>o are generally unknown. To get some feasible Monte Carlo approximation scheme, we need a 
dedicated technique to sample the transitions of this chain. One natural strategy is to replace in ((2|), 
the reference Markov chain {Xt n )n>o by the Markov chain {Xt n )n>o associated with some Euler type 
discretization model with time step At = 1/m. The stochastic analysis of these models is discussed in 
some detail in the articles |17[ [TBI US] , including first order expansions in terms of the size of the time 
mesh sequence. 

Our second main result is the following non asymptotic bias and variance theorem for the TV- 
approximation mean field model introduced in ([8]). 

Theorem 3.2 We assume that the Markov transport equation ^) is satisfied for Markov transitions 
•St n ,fi a l so satisfying the first order decomposition (0|). 

In case (C), for any function f £ D{L), and any N > m > 1 we have the non asymptotic bias and 
variance estimates 

|lE(^(/))-^(/)|<Q n (/) [^ + ^ 

and 

~ 1 1 



e([/x£(/)-^(/)] 2 ) <c tn (f) 



N m? 



for some finite constant ct n (f) < oo that only depends on t n and on f . 

In case (D), for any f £ Bb{E) s.t. osc(/) < 1, and for any N > m > 1 we have the non 
asymptotic bias and variance estimates 

N \E «(/))- V n(f)\<a(n) and N E ([^(/) - m n (/)]')< o(n) (l + ± a(n) 

for some some constant 

a{n)<c ^ 9k,n9k,k+i (II l ogG k \\ V l) 2 /3(P fcjn ) with g k)7l := swpQ k)n (l)(x)/Q kjn (l)(y). 

o<k<n x ' y 

Under appropriate regularity conditions on the Feynman-Kac model, we can prove that the constant 
a(n) is uniformly bounded w.r.t. the time parameter; that is we have that sup n>0 a(n) < oo. For a 
detailed discussion of these uniform convergence properties w.r.t. the time parameter, we refer the 
reader to the book |10| . and the more recent article [16J. To be more precise, we let $fc,/( ? ?fc) = ill be 
the Feynman-Kac semigroup associated with the flow of measures n k . In this notation, by proposition 
2.3 in |23| we have that the Dobrushin contraction coefficient of the Markov kernel Qk,n{f) / Qk,n{^-) is 
given by 

/3{Pk,n) = sup ||$ fcjn (/ii) - $fc in (/i 2 )|| tv • 
(Ui,At2eP(B) 



On the other hand, we also have that 



Q fc , n (l)(x)= ' ^ M (^)(G/)^log ^- n = Yl (lo&QkMiGO-logQkMiGt)). 

k<Kn k<l<n 
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Using the fact that log a — log b = j-^rj^r dt, we find that 



fc<Z<n 

Assuming that for any / and x, and 



ci<GKz)<c 2 and sup \\* k ,l(pi) - *kM\L < <% e^-** (10) 



for some positive and bounded constants q, 1 < z < 4, we find that 

m,n) < c 3 e -*(*-») and log g k>n < 2(c 2 c 3 / Cl ) I V e~ c ^ \ < 2( C2 c 3 )/( Cl (l - e" C4 )). 




This clearly implies that (|10p =4- sup n>0 a(n) < oo. 

For instance, it was proven in |21l [Tl] that condition (|10|) is met for time homogeneous models as 
soon as the Markov transition M of the Markov chain X n satisfies the following mixing condition 



3m > 1, 3p > : \/x,y £ E M m (x, .) > p M m (y, 



It is well known that this condition is satisfied for any aperiodic and irreducible Markov chains on finite 
state spaces, as well as for bi-Laplace exponential transitions associated with a bounded drift function, 
and for Gaussian transitions with a mean drift function that is constant outside some compact domain. 
The remainder of the article is organized as follows: 

Section [4] is concerned with continuous time particle interpretations of the Feynman-Kac models 
([TJ . By the representation theorem 13.11 these schemes also provide a continuous time particle inter- 
pretation of the discrete time models ([3]) without further work. In section [4~2l we present the McKean 
interpretation of the Feynman-Kac models in terms of a time inhomogeneous Markov process whose 
generator depends on the distribution of the random states. The choice of these McKean models 
is not unique. We discuss the three interpretation models corresponding to the three selection type 
transitions presented on page [5j The mean field particle interpretation of these McKean models are 
discussed in section [4~3l 

Of course, even for discrete time models ([3]) these continuous time particle interpretations are based 
on continuous time interacting jump models and they cannot be used in practice without an additional 
level of approximation. In this context, when using an Euler type approximation these exponential 
interacting jumps are replaced by geometric type recycling clocks. These interacting geometric jumps 
particle models are discussed in section[5j which is dedicated to the discrete time particle interpretations 
of the Feynman-Kac models presented in ([2]). In section [5TT| we discuss the McKean interpretation of 
the Feynman-Kac models in terms of a time inhomogeneous Markov chain model whose elementary 
transitions depends on the distribution of the random states. Again, the choice of these McKean 
models is not unique. We discuss the three interpretation models corresponding to the three cases 
presented on page [5j The mean field particle interpretation of these McKean models are discussed on 
page M 



Once again, using the representation formulae (|2|) we emphasize that these schemes also provide 
a discrete generation particle interpretation of the discrete time models Q. In contrast to standard 
discrete generation particle models associated with ([3]), these particle schemes are defined on a refined 
time mesh sequence between integers. This time mesh sequence can be interpreted as a time dilation. 
Between two integers, the particle evolution undergoes an additional series of intermediate time evo- 
lution steps. In each of these time steps, a dedicated Bernoulli acceptance-rejection trial coupled with 
a recycling scheme is performed. As the time step decreases to 0, the resulting geometric interacting 
jump processes converge to the exponential interacting jump processes associated with the continuous 
time particle model. The final section, section is mainly concerned with the proof of theorem 13.21 



4 Continuous time models 
4.1 Feynman-Kac semigroups 

In case (C) the semigroup of the flow of non negative measures v t is given for any s < t by the following 
formulae vt = v s Q s ,t, with the Feynman-Kac semigroup Q s j defined for any / G B(E) by 

Q s ,t(f)(x) = E (f(X t ) exp jjf* V S (X S ) ds} \X s = xY 

This yields fit = ^sjiUs), with the nonlinear transformation $ s> t on the set of probability measures 
defined for any / £ B(E) by 

<MMs)(/) :=/U s (Q s , t (/))//i s (Q s , t (l)). 

Using some stochastic calculus manipulations, we readily prove that fit satisfies the following integro- 
differential equation 

j t fi t {f) = MLt(f)) + tH(y t f) - MVt)»t(f) (ii) 

for any function / E D(L). Further details on the derivation of these evolution equations can be found 
in the articles |24[ 122], The particle interpretation of this model depends on the interpretation of the 
correlation term in the r.h.s. of (|lip in terms of a jump type generator. The choice of these generators 
is not unique. Next, we discuss three important classes of models. These three situations are the 
continuous time versions of the three cases discussed on page [5j 

• Case 1 : We assume that Vt = —Uu f° r some non negative function tit- I n this situation, we 
have the formula 

MV*/) " th(yt)th(J) = IH{U t \iHtf) - /]) = IH (L UH (f)) 
with the interacting jump generator 

L ttlH {f){x)=U t {x) [ [f(y)-f(x)]Mdy). (12) 
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Case 2 : When Vt is a positive function, then we have the formula 

ih(ytf)-iH(v t )iH(f) = m (w/)) 

with the interacting jump generator 

= / [/(y) - f(x)] V t (y) nt{dy) = ihQ>t) I [f{y)-f{x)]*vM{dy). (13) 



Case 3 : For any bounded potential function Vt we have 

MVt/) - MVt)M/) = | (/(!/) " /(a:)) (V t (y) - V t (x)) + m(dx) m{dy) = m (Lt,^{f)] 
with a+ = a V 0, and with the interacting jump generator 

= [ lf(y) - f(x)} (V t (y) - V t (x))+ Mdy). (14) 



4.2 McKean interpretation models 

In the three cases discussed above, for any test functions / G D(L) we have the evolution equation 

^t(f) = M L t,vt(f)) with L t>flt := L t + L t>flt . (15) 

These integro-differential equations can be interpreted as the evolution of the laws, given by Law(X^) = 
fit , of a time inhomogeneous Markov process Xt with infinitesimal generators Lt ftH that depend on the 
distribution of the random states at the previous time increment. This probabilistic model is called 
the McKean interpretation of the evolution equation (|15p in terms of a time inhomogeneous Markov 
process. In this framework, using Ito's formula for any test function / € C 1 ([0, oof, T>(L)), we have 



[§- t + L t,^)(ft) 



with a martingale term Mt(f) with predictable angle bracket 

d(M(f)) t = T Lt ^(f t J t )(X t )dt. 
Using the r.h.s. description of L% „ t in (|15p . for any / E D(L) we notice that 

r Lt , Mt (/,/) = r it (/,/) + r £ ^ (/,/). 

Next, we provide a description of this Markov process in the three cases discussed above. 

• Case 1: In this situation, between the jump times the process Xt evolves as the process Xt- The 
rate of the jumps is given by the function Uf In other words, the jump times (T n ) n >o are given 
by the following recursive formulae 

T n+1 = inf <t > T n : / U S (X S ) ds > e n 



: f U S (X S 
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where To = 0, and (e n ) n >o stands for a sequence of i.i.d. exponential random variables with unit 
parameter. At the jump time T n the process Xt„- = x jumps to new site Xt„ = y randomly 
chosen with the distribution ^T n ~{dy)- 

For any / £ D(L) we also have that 

r lt Jf,f)(x) = L t ^{(f-f(x)) 2 )(x)=U t (x) J [f(y)-f(x)] 2 Mdy). 

In this situation, an explicit expression of the time inhomogeneous semigroup V s ,t,a s i s < t, of 
the process Xt is provided by the following formula 

Vs,t,M{%) = \X. = x) 

= Q s , t (l)(x)<S> s , t (5 x )(f) + (l-Q Sjt (l)(x)) $sM(f) 

= Q M (/)(*0 + (1 - Q.,*(l)(x)) <M/^)(/)- 

We let 7-+ ) ,, and <J?+ m ) be the Markov transition and the transformation of probability 
measures defined as V s ,t,n a and &t n .t n+1 replacing Qt n ,t„ +1 by the integral operator 

(/)(*) = e"^^)/- E (/(* t „ +1 ) | X tn = x) . 
Under the assumptions of theorem 13. 1| using elementary calculations we prove that 



with some remainder signed measures 7^™4 n+1 ^ t such that sup m>1 



tn,tn + l,fJ-t r , 



< Q„, for 



some finite constant whose values only depend on the potential function hit- 



Case 2: In this situation, between jump times the process Xt evolves as the process Xt. The 
rate of the jumps is given by the parameter /^(Vt). In other words, the jump times (T n ) n >o are 
given by the following recursive formulae 



T n+ i = inf { t > T, 



/ fjL s (V s ) ds > e r 



where To = 0, and (e n ) n >o stands for a sequence of i.i.d. exponential random variables with unit 
parameter. At the jump time T n the process Xt„— = x jumps to new site Xt„ = y randomly 
chosen with the distribution Vty _(//7^_)(dy). 

For any / 6 D(L) we also have that 



Lt tlH 



(/, f)(x) = L t ,, t ((/ - f{x)f) (x) = J [f(y) - f(x)] 2 V t (y) fH(dy). 



Case 3: In this case, between jump times the process Xt evolves as the process Xt. The rate of 
the jumps is given by the function 

= /it(V t l Vt >v t (*)) " KM > V t (x)) V t (x). 
In other words, the jump times (T n ) n >o are given by the following recursive formulae 



T n+1 = inf it > T n : / W t ^ t (X s ) ds > e n 

where To = 0, and (e n ) n >o stands for a sequence of i.i.d. exponential random variables with unit 
parameter. At the jump time T n the process Xt„— = x jumps to new site X^ n = y randomly 
chosen with the distribution ^ {VTn ^ VT j x))+ (fi Tn _). 

For any / 6 D(L) we also have that 

r Z t „ t (/• f)W = ^ ((/ " /CO) 2 ) 0*0 = / if(v) ~ (Vt(y) - V t (x)) + Mdy) 



so that 



IH 



r £t „.(/,/) 



\f{y) - f{x)] 2 (V t (y) - V t (x)) + ^ t {dx)^{dy). 



(18) 



We end this section with another McKean interpretation model combining cases 1 and 2, as an 
alternative to the generator described in the latter case. First, using the fact that 

ih {Wt - iH(v t )} + - [v t - fH(Vt)L) = in ([v t - m(v t )}) = o 

we prove the following decompositions 

iH{v t f)-m{Vt)m(f) = iH{[Vt-iH{Vt)]f) 

= IH ([Vt - IH{V t )] + f) - IH {[Vt - IH{Vt)\- f) 
= IH{[Vt-fH(Vt)] + [f-IH(f)}) 

-IH{[Vt- IH{V t )}_[f - IhU)}) ■ 

Using the same line of arguments as those used in cases 1 and 2, this implies that 

»t(Vtf)-IH(Vt)lH(f)=lH(Lt,mV)) with L t ^ t =L^ t +L Ult 
where the pair of interacting jump generators is given by 



^ t {f)(x) = [Vt{x)-lH{V t )]_ I [f{y)-f{x)]ii t {dy) 



and 



[/(y) - /(*)] [Vt{y)-»t{V t )] + in{dy). 
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In this situation, for any / £ D{L) we also have that 

r z (f,f)(x) = r z+ (/,/)(x) + r £ (/,/)(*) 

[/(y)-/(*)] 2 {[Vt(y)-^(Vt)] + + [V t (x)-MVt)L) inidy) 



so that 



r 



L t Jf'f) = / [/(2/)-/(^)f \Vt(v)-IH(Vt)\ lH(dx)tH(dy). 



4.3 Mean field particle interpretation models 

The mean field iV-particle model £j := (Cl) k^<a^ associated with a given collection of generators Lt >IH 
satisfying the weak equation (fT5|) is a Markov process in E N with infinitesimal generator given by the 
following formulae 

C t (F)(x\...,x N ):= L t)n(x)(F)( xl i ■ ■ ■ ,x\. . . ,x N ) with m(x):=± £ S x i (19) 

l<i<N l<i<N 

for sufficiently regular functions F on £7^, and for any x = (x*)i<j<7v G E . In the above formulae, 
^tm(x) stands for the operator L t ^ m ^ acting on the function x l i— > F{x l , . . . , x l , . . . , 

Before entering into the description of the particle model associated with the three cases presented 
in section 14.21 we provide a brief discussion of the convergence analysis of these stochastic models. 
Firstly, we recall that 

dF{i t ) = Ct(F)^t) dt + dM t (F) 
for some martingale J\At{^) with increasing process given by 

(M(F)) t := [ r Cs (F,F)(Q ds. 
Jo 

In the above we denote by Tc a the carre du champ operator associated with C s , and defined by 

T £s (F, F) (x) := C s [(F - F(x)) 2 ] (x) = C s (F 2 )(x) - F(x)C s (F)(x). 
For empirical test functions of the following form F(x) = m(x)(f), with / £ F)(L), we find that 

C,(F)(x) = in(x)(L sMx) (f)) and T Cs {<p,<p) (x) = — m(x) (Tl sMx) (/, /)) • 
From this discussion, if we set nf = Yli<i<N <^*> then we find that 



dtf{f) = rf(L w (f)) dt + — dM t N (f) 



1 

ft 

for any / £ F>(L), with the martingale Mj^(f) = \fN Ai t [F) with angle bracket given by 



(M N (f))f-= / /^(Tl^ (/,/)) ds. 

J 
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A more explicit description of the r.h.s. terms in the above can be given in the three cases discussed 
in section [4721 For instance, in the third case, using formula f|18|) we find that 

(M N (f)) t := jT J [f(y) - f(x)] 2 (V s (y) - V.(x))+ tf(dx)tf(dy) ds. 

We conclude that fj^ "almost solve", as N f oo, the nonlinear evolution equation (|15|) . For a more 
thorough discussion of these continuous time models, we refer to the reader to the review article |15| . 
and the references therein. 

By construction, the generator Ct associated with the nonlinear model (|15p is decomposed into a 
mutation generator £™ ut and an interacting jump generator £J ump 

Ct = C mnt + £) nmp 

with £ t mut and 4 ump defined by 

CT Ut (F)(x) = £ Lf\F)(x\...,x\...,x N ) 



l<i<N 



i(x) 
l<i<N 

The mutation generator £™ ut describes the evolution of the particles between the jumps. Between 
jumps, the particles evolve independently with Li-motions in the sense that they explore the state 
space as independent copies of the process Xt with generator Lf. The jump transition depends on the 
form of the generator Lt^ t ■ 

• Case 1: In this situation the jump generator is given by 

/f mp (F)(x) = £ Ut&) [[F(ei(x))-F(x)]m(x)(du) 

l<i<N J 

with the population mappings Q % u defined below 

9i : xeE N ^6 i u {x) = {x 1 ,...,x i -\^,x i+1 ,...,x N )eE N . 

i-th 

The quantity Ut(x\) represents the jump rate of the i-th particle Q. More precisely, if we denote 
by T l n the ra-th jump time of we have 

r^ +1 =inf|t>T; : j\(Ods>e0j (20) 

where (e* t )i<,;<7v,neN stands for a sequence of i.i.d. exponential random variables with unit 
parameter. At the jump time the process Q Ti _ = x l jumps to new site £L = u randomly 

n n 

chosen with the distribution m(^ T i _)(du). In other words, at the jump time the i-th particle 
jumps to a new state randomly chosen in the current population. 
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The probabilistic interpretation of the jump generator is not unique. For instance, it is easily 
checked that £| ump can be rewritten in the following form 

Cr P (F)(x) = X t (x)J[F(y)-F(x)]V t (x,dy) 

with the population jump rate Xt(x) and the Markov transition Vt(x, dy) on E N given below 

X t (x) := Nm(x) (U t ) and V t (x,dy) = ^ Ut ^ X ] t , ^ ]T S gi , {x) (dy). 

i< t < N ^<i'<N Ut y x ) Iy !<j< N xJ 

In this interpretation, the individual jumps are replaced by population jumps at rate \t(£t)- More 
precisely, the jump times T n of the whole population are defined by 













T n+ i = inf < 


t>T n : 






ds > e n | 




< 


l<i<N 





where (e n ) ng isj stands for a sequence of i.i.d. exponential random variables with unit parameter. 
At the jump time T n the population £t„- — x jumps to new population £t„ — V randomly chosen 
with the distribution VT n -(£,T n -,dy). In other words, at the jump time T n , we select randomly a 
state 0r n - with a probability proportional to tit(^ _), and we replace this state by a randomly 
chosen state £^ _ in the population, with 1 < j < N. We end this description with an alternative 
interpretation when \\Ut\\ < C for some finite constant C < oo. In this situation, we clearly have 
|| A t || < NC and 

4 ump (F)(x) = A' f [F(y) - F(x)] V' t (x,dy) 



with the jump rate A' and the Markov jump transitions V[ defined below 

\' = NC and V' t {x 1 dy):=^V t {x,dy)+{l-^pj 5 x {dy). 

In this interpretation, the population jump times T n arrive at the higher rate A' = NC. At the 
jump time T n the population £t„- = x jumps to new population £t„ — V randomly chosen with 
the distribution _(^T n -i dy). 

In the models described above, as usual, between the jump times T n of the population every 
particle evolves independently with Lj-motions. 

Case 2 : In this situation, the jump generator is given by 

£r P (F)(x) = E ™(x){Vt) J[F(0l(x))-F(x)]V Vt (m(x))(du). 



Ki<N 



The particles have a common jump rate given by the empirical average m(^)(Vt). In other words, 
the jump times of a particle Q are given by the following recursive formulae 



^ +1 =inf|t>r; : j* m(£ s )(V s ) ds > 4 



15 



where (e^)i<j<Ar in >o stands for a sequence of i.i.d. exponential random variables with unit 
parameter. At the jump time the process £,j< n _ = x % jumps to new site £y = u randomly 
chosen with the weighted distribution \l/y T _ ( m (^T„~))(du). 

As mentioned in the first case, the probabilistic interpretation of the jump generator is not 
unique. In this situation, it is easily checked that £| ump can be rewritten in the following form 



C 3 t ump (F)(x) = X t (x) J[F(y)-F(x)]V t (x,dy) 
with the population jump rate Xt and the Markov transition Vt{x,dy) on E N defined below 
X t (x) := Nm(x){V t ) and P t {x,dy) = ± £ E v ^ - 8 &i , {x) (dy). 

iV l<i<N l<j<N ^<3'<N *\ > xJ 

The description of the evolution of the population model follows the same lines as the ones given 
in case 1. 

• Case 3 : In this situation, the jump generator is given by 

£r P (F)(x) = E / - (Vt(«) - V t (x*)) + m(x)(du) 

l<i<N J 

= J2 m ( x )((Vt - Vtix^U) [ [F($i(x)) - F(x)] * (Wf _ Vt(a! i) )+ (m(x))(du). 



l<i<N 

In this interpretation, the jump rate of the i-th. particle is given by the average potential variation of 
the particle with higher values 

m(x)((V t -V i (x l )) + ) = l E Hvt&WW} WJ-VtCx*)). 
More precisely, if we denote by the ra-th jump time of £|, we have 

r; +1 = inf|t>r; : jT m(6)((v s - v s (£))+)ds > <J 

where (eJJi<i<jv,neN stands for a sequence of i.i.d. exponential random variables with unit parameter. 
At the jump time the particle £L_ = x l jumps to new site £L = u randomly chosen with the 
distribution 



*(V T ,_-V T ,_M) + (^(^-))(^)oc E !f v ( _ (e , )>VTl _ M j ( V ^(%_)-V T ,_(^)) ^ (du). 



In other words, we choose randomly a new site £L = £L_, among the ones with higher potential value 

-*- n ri 

with a probability proportional to the difference of potential ( V^_(^ i _) — V T ^_(^ i 
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As the first two cases discussed above, we can also interpret this jump generator at the level of the 
population. In this interpretation we have 



Cr P (F)(x) = X t (x) I [F(y) - F(x)] V t (x,dy) 
with the population jump rate 

\ t (x) = N I m(x)(du) m(x)(dv) (V t (u) -V t (v)). 



and the population jump transition 



Remark 4.1: In case (D), the reference Markov process Xt = Iw has deterministic and fixed 
time jumps on integer times so that the generator approach developed above does not apply directly. 
Nevertheless their probabilistic interpretation is defined in the same way: 

Between the jumps, the process Xt evolves as Xt, and the N particles explore the state space as 
independent copies of the process Xt. The rate of the jumps and their random spatial location are 
defined using the same interpretations as the ones given above. 

The stochastic modeling and the analysis of these continuous time models and their particle inter- 
pretations can be developed using the semigroup techniques provided in |25j. 



(Vt(xi) - V t (x% 



5 Discrete time models 

5.1 McKean models and Feynman-Kac semigroups 

As in the continuous time case, these discrete time evolution equations (jTJ) can be interpreted as the 

evolution of the laws defined by Law (Xt n ) = /4 of a time inhomogeneous Markov process Xt n with 
Markov transitions generators K ( m ) that depend on the distribution of the random states at 

the previous sub-integer mesh time increment. This probabilistic model is also called the McKean 
interpretation of the evolution equation (J7| in terms of a time inhomogeneous Markov chain. By 
construction, the elementary transitions of the Markov chain Xt n ~^ Xt n+1 are decomposed into two 
separate transitions Xt n Xt n ~» Xt n+l . 

First, the state Xt n = x jumps to a new location Xt n = y randomly chosen with the Markov 
transition S ( m )(x,dy), given by one of the three cases presented in section 2.2 when applied to 

*n>A*t„ 

the particle approximation of the measure /4"^ at mesh time increment t n . Then, the selected state 
Xt n = y evolves to a new site Xt„ +1 = z according to the Markov transition Mt n ,t n+1 (y, dz). 

Next, we recall some basic properties of the semigroup <&t^\ n of the flow of measures ■ By 
construction, we have 

^t p ,t n i^t p )(/) = A*tp Qt p ,t n (f)/^tp Qt p ,t n (l) 
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with Feynman-Kac semigroup Qt\ n defined by 



Qt' n (f)(x) = E I f(Xt n ) II e v ^l m \X tp = x . (21) 

\ p<q<n J 

We notice that when we consider the Boltzmann-Gibbs transformation associated with the potential 
function G { ™\ = (1) then the semigroup of the flow of measures fj,[ m ^ can ' 3e expressed according 

to 

= (»l?)P$ n with Pgl (f) = Q ( Cl (/)/Qil(l). (22) 

Definition 5.1 We consider the integral operators 

4 m ) -=)C t t +,u- Id, 4 m) := 7W t t , . - Id and If 1 ), := S t u - Id. 
Lemma 5.2 We /iai>e t/ie decomposition 

r( m ) _ rM , ?M , f ( m ) r( m ) 
In addition, for any f £ Bb(E) [i £ V{E), and any x E E, we have 

JCt n ,t n+1 ,„ ([/ - JCt n ,t n+1 Af)(x)] 2 ) (*) =I>, (/,/)(*) - (L£l(f)(x)) 2 . 
Proof: Using the decomposition 

Lti = {M tn , tn+1 -Id)+(S t ^-Id) + (S tn ^-Id){M tn , tn+1 -Id) 
we readily check the first assertion. We prove the second decomposition using the fact that 

[Kt„,w(/)] 2 = (O/)) 2 + f 2 ~ 2 /4S(/)- 
This ends the proof of the lemma. ■ 

In the further development of this section Q n < oo stands for some generic finite constant whose 
values may vary from line to line. For any function / € D{L), such that Lt(f) € C l {\t n , i n +i]> 
we also define 

ll/lk := 11/11 + ^p (\\dL t (f)/dt\\ + \\L t (f)\\ + \\L 2 t (f)\\) . (23) 
t n <t<t„+i 

Proposition 5.3 In case (D), we have 

= l N (t„+i) (M tn+1 - Id) and = £g + l N (t n+1 ) S tnt , (M tn+1 - Id) . 

In case (C), we have the first order expansion 

L^\f) = L tn (f) ~ + RtM) — 2 - (24) 
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for any function f £ D(L), such that Lt(f) £ C 1 ([t n ,t n +i], D(L)) , with some remainder operator Rt n 
such that ||i?t„(/)|| < Ct n \\f\\t„- Furthermore, we have the first order expansion 

L^(f) = 1 L W (/) + — 2 R tn M) (25) 

with some second order remainder term Rt n ,fj,(f) such that sup^-p^ ll-^«,/u(/)ll — c i ?l 1 1 /II in • ^ n addi- 
tion, we have 



/Ct n ,t n+ i^([/-^ n , tn+ i,M(/)(^)] 2 )(^) = rL tn , (1 (/,/)(x) - + n tn , li (j,f)(x) \ (26) 

with some remainder operator s.t. sup Mg -p( £ ) \\1^tn,n (/, /)|| < Q„ ll/ 2 |k- 



The proof of proposition 15.31 is provided in the appendix, on page [36j 

The first order expansions stated in the proposition 15.31 can be used to develop a stochastic per- 
turbation approach to estimate the deviations of the measures /4 around their limiting values fit n . 
Next, we provide an alternative approach based on the explicit representation (|17p of the time inhomo- 
geneous transition of the limiting process X tn on the time mesh sequence t n . In the first case discussed 
on pagellO[ we have 

Vt n+1 ~ % n ,t n +l [thn ) — * e -Mt»/» [tHn ) M tn,t n +1 ~ M tn 7^ ( m ) (27) 



with the Markov transition 

= e~ u ^' m M tn , tn+1 (x,dy) + (i - e ~^^/ m ) * e -u tn/m .M Wn+1 (^). 

Using (I17p we readily find that 
with the signed measure 

< ct 



(28) 



:= d^tl +1 a t s.t. sup 

m>l 



tv 



for some finite constant whose values only depend on the potential function Z^. In summary, we have 
proven the following first order local perturbation decompositions 

Mt n+1 - ^Wn+i ^ ) + — w t„,t„+i 



These local expansions allow the use of perturbation theory developed in section 7.1 of |10] to derive 
several qualitative 
Kac semigroup $t n ,t„ +1 . 



several qualitative estimates between /4 and fit n in terms of the stability properties of the Feynman- 
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5.2 Mean field particle interpretation models 

If we set jjbf n = jj X/i<i<AT $q i then we have the decomposition 

1 



,,N _ ,.N tr , x jjrN 



with the sequence of empirical random fields t n+1 such that 



v(w t N nttn+1 (f)\t tn )=o 

and 

e(< Wi (/) 2 | e^) = | M £» /c Wn+liM *>,^) (/W-£ Wn+1 ,, fn (/)W 

As for the continuous time models, we conclude that fi^ "almost solve", as N f oo, the nonlinear 
evolution equation ([7]). For a more thorough discussion of these local sampling random field models, 
we refer the reader to |1C H 115 1 [TB]. an d references therein. 

By construction, the elementary transitions of the Markov chain £t„ ~* £t n+1 are decomposed into 
two separate transitions: 



^-^^y^-w (29) 

First, every particle £| = jumps independently to a new location £| = j/* randomly chosen 
with the Markov transition S tn ^ m ^ t ^{x l ,dy l ), with 1 < i < N. Following this, each particle Q n = y l 
evolves independently to a new site Q n+l = z% according to the Markov transition Mt n ,t„ +1 (y\ dz l ), 
with 1 <i< N. 

In other words, the mutation transition describes the evolution of the particles between the jumps. 
Between the jumps, the particles evolve independently with Ait n ,t n+1 -motions in the sense that they 
explore the state space as independent copies of the process Xt n with Markov transition Mt n ,t n+1 - The 
jump transition can also be interpreted as an acceptance-rejection transition equipped with a recycling 
mechanism. In this interpretation, the mutation transition can be interpreted as a proposal transition. 
Notice that the selection type transition is dictated by the choice of the transition St n ^ tn - 

We illustrate these jump type transitions in the first case presented on page[5j In this situation, we 
recall that the selection transition of the i-th particle £| ~» £| is given by the following distribution 

S tn ^l,dy) := e -*»«U"» S^dy) + (l - e^OM) ¥ e -^/»«)(c&). (30) 

Next, we provide an interpretation of this transition as an acceptance-rejection scheme with a 
recycling mechanism. We let £t n = ^£t n ) be a sequence of conditionally independent random 

variables with common law 



l<i<N 



e -U tn {QJ/ m 
l<i<N Yll<j<N e 



* -u t / m (uf f ) = — - — - — ■ — s f i 



We also consider a sequence of conditionally independent Bernoulli random variables with distribution 

p(4 = i|6J = i-p(4 = 0UO 



e -"tn(C)/ m . 
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In this notation, we have that 



S. = 4 a + (i - 4J € 



In in other words, the particle £| is accepted when e\ n = 1; otherwise, it is rejected and replaced by 
a particle Q n randomly chosen with the updated weighted distribution ^ e -w tn /m(/^). The pool of 
particles that have been accepted from the start provide a sequence of exact samples. More precisely, 
it can be easily shown that 

Law( £L | Vp : < p < n, e! = 1) = Ht n - 



See for instance section 1.5.1 in |10| . 

In connection with ()20|) . we notice that the rejection times T\ on the time mesh (t q ) q >o can be 
defined as follows 



rpl 

J n+1 



inf < 



t > T % 



T*<k<t 



inf k t p > r n 




Ti <k<t 



where (i4i)i<i<iV,neN stands for a sequence of i.i.d. uniform random variables on ]0, 1], and e l n : = 
— logu^, with 1 < i < N, n S N, is the corresponding sequence of i.i.d. exponential random variables 
with unit parameter. We check this claim using the following observations 

p(r* +1 = i p |r*, yT; t <k<t p Q k ) 



VT* < k < t p e tk = 1, e\ p = | I*, V T n < k < t p Q k 



n 



Ti<k<t v 



x 1 



-U tp ($i p )/m\ 



g ^T\<k<tp^k^t k )l ••" X ^1 - e ~ Ut P^t p )/ m 



UtM k )lm < < < E n <k<tUt k (e tk )/rn \T W VT^Kf, Q k 

At the jump time the process £L = jumps to new site £L = u randomly chosen with the 
distribution 



(31) 



5.3 An mean field model with uniform recycling 

When m is large enough, the recycling distribution (|3ip in the Markov transition (j30|) is almost equal 



to u^, . For instance, we have the total variation estimate 



* -W i /m (/^yi ) — /iyi 



< 



1 



/m 



<||^||/m. 
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We prove these inequalities using the decomposition 



* e -W/m(/i)(/)-M/)=M( 



-U/m 



[*e-U/ m (»)(f)-f] 



which is valid for any bounded functions U and /. Hence, to save computational time we can replace 
the recycling weighted measure VP _w 4 /m (fe ) by . In this situation, the selection transition takes 
the following form 

where t\ stands for a sequence of i.i.d. uniform random variables on ]0, 1]. 

Next, we detail some analysis of the differences between the McKean models with recycling Boltzmann- 
Gibbs transitions, and the models discussed which utilise uniform recycling. 

We let St n:fl the collection of selection transitions defined as in (|30p . by replacing ^> e -u tn /m (//) by 

the measure /i. Furthermore, we denote by ^[ m J n , resp. ^j"^, with p < n, the semigroups associated 



with these flows 



Zl m) and d m } (d m) 



(m) 

a4„ • 



Then, using the decomposition 
we find that 



(x,dy) = (l - e~ u ^ (*)/"») (V e -u /m (ji) - fi) (dy) 



sup 



Su,^x, .) - S^x, .) < \\UtJ 2 /m 2 . 

tv 

Replacing VP _w t „/m (//) by the measure [i in (|28|) . the evolution equation (|27p takes the following form 



;(m) 



r (m)^(m) 



From previous estimates, we find that 



4^1 (u)=*n (At)+^T^n (At) 



dm) 



with P 



(m) 



5 ~Cm)7Wt n , 



n+1 - 



with some measures Tzi m l (a) s.t. 



sup 



M t < 11%. 



We end this section with an estimate of the difference between the flow of measures u,[ m ^ , and u,i m \ . 
We are now in position to state, and to prove the following theorem. 

Theorem 5.4 For any n > 0, we have 

< c tn /m 



~(m) (m) 

a4 a4 



tv 



for some finite constant ct n < 00, whose values don't depend on the parameter m. 
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Proof: We use the stochastic perturbation analysis developed in section 6.3 in |16| (see also chapter 
7 in [10]). We denote by resp. <^^\ n , with p < n, the semigroups associated with these flows 



$M ~M and $M / (m) 

tp^tn \ >tp J 'tn tp->tn \ 'tp 



(m) 



Using the interpolating sequence of measures 



<p<n^<l =*ZHti 



t ,t p \rt 



d m ) ( ~( m ) 



from the distribution 

(to) / T(m) ,~(ra), 



Recalling that /ifi = Mto > we find that 



(m) / ^(m) /~Mn 



rM 



~(m) (m) 

AH Mt 



n 



9=1 

£ 

3=1 



<I> 



(m) / ,(m) 



*tU (a^O + ^ <-U (m^)) - <1 



u (m) 



By ()22p . we prove that 

*S>)-*H>)1 (/) 



* r (m) (^) - 0) 



p{m) / ,-, 



i/ G 



(m) 



[A* - v ] 



"Mi 



,(m) 



This implies that 



with the Dobrushin contraction coefficient /3 \P^ m } ) (< 1), and the parameters 



/->( m ) / \ 
(m) Wp^W , 

o; ; := sup — f—^ < exp (2t n sup 



This yields the rather crude estimates 



m 



~(m) (m) 
r^tn A^t n 



P =i 

< 2i n exp (2r n sup 
te[o,t„ 



tlU sup 

te[o,t„ 
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This ends the proof of the theorem. 



Working a little harder, under some regularity conditions, the estimates developed in the proof 
of the theorem can be used to obtain uniform estimates w.r.t. the time parameter. For instance, in 
case (D), under the stability conditions (|1U|) . the constant c± n in theorem 15.41 can be chosen so that 
sup n Q n < oo. We can extend these uniform results to continuous time models, using the stability 
analysis of continuous Feynman-Kac semigroups developed in |23| . 



6 First order decompositions 

The main objective of this section is to prove theorem 13.21 In the further development of this section 
we let c, c n , Ct n , and be, respectively, some universal constant, and some finite constants that 

depend on the parameters n, t n , and the pair (t n , /), with values that may vary from line to line but 
do not depend on the parameters m and N. We also assume that m is chosen so that ||Vt n || < Ct n m, 
for any n > 0, and N > m. 



6.1 Continuous time models 

We start with the continuous time case (C) presented on page(3J By lemma [531 we find that 



,iV 



I\(m) (/, /) 



L 



(m) 



(/) 



(32) 



Using ([26]), for any function / G D(L), such that L t (f), L t (f 2 ) G C 1 ([t n ,t n+1 ],I?(L)), we find that 



r\ „(/,/) 

tn,l* tn 



1 + ~ 2 

m m z 



with some remainder term (/) such that 



sup|<(/)| < c tn 



N>1 

with the norm ||/||t n of a function / G D(L), such that Lt(f) G C 1 ([i n , D(L)) defined in (|23p By 

( 1211 ). we have 



Q ( Cl(f)(x)=E[f(X tn ) exp 



Xt=x 



with r(s) = Xm>o l[in,i, l +i[( s ) ^n- Thus, in case (C), for any function / G D(L), the mappings 



t G [t p _i,y ^ L t (Q^i(/)"J and f G [t p ^t p ] ^ Lf [Q^f) 

are uniformly bounded w.r.t. the parameter m, and differentiable with uniformly bounded derivatives 
w.r.t. the parameter m. 

The first assertion of theorem 13.21 is based on the first order decompositions of the fluctuation of 
fi^ around its limiting value developed in |16j . Using theorem 6.2 in |16j . we prove the following 
proposition. 
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Proposition 6.1 For any N > 1 and any n E N, we have 



N 



D 



^2 N /-£j(m,N)\ ' 



P=0 Vt v 



(m,N) 



(/) 



n _. 



p=0 



uwi/i f/ie /irsf order integral operator 



and the remainder second order term 

n , 

,{m,N) ( \ -« 



^r ] (/) = -E 



-^(m,iV)\ N 



In t/ie above, we have used the convention to = \fN[/j, ] ^ j — fit ], for p = 0. 

We are now in position to prove the bias and the variance estimates stated in theorem 13.21 for the 
continuous time models. 

Proof of theorem 13.21 - case (C): 

Firstly, the first order decomposition stated above clearly implies that 



N E 



On the other hand, we have 



n / „s 1/2 / 



p=0 

To get one step further, we use the fact that 



1/2 



(<tf ) (/) 1 A i ;r ; (/)) 



(m,JV). 



r p-i 



After some elementary manipulations we prove that 



sup E (w t N p _ utp (D$p(fjf) < ctM)/m and sup E (w t N p _ utp (g^Y) < c t Jm. (33) 

0<p<n \ / 0<p<n \ / 

This ends the proof of the bias estimate. 

The proof of the variance estimates is based on the following technical lemma. 
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Lemma 6.2 For any f with osc(/) < 1, we have the fourth conditional moment estimate 

E (<a +1 (/) 4 i 6») < ^ E (<*„ +1 (/) 2 1 e*») + e e (< tn+1 (/) 2 1 

Proof: With some elementary computation, we have that 
E(< Wl (/) 4 Ut 

+6 (1 - ^ (Ai)A^ (d«') („, A,) (/(„) - /C^^ (/)(«) 



/C 



(/("') (/)(«') 



This implies that 



E(< Wl (/) 4 |^) < ^ j nZ{du) IC^^dv) (f(v)-)C tn!tn+1)< (f)( U 



+6 



The end of the proof is based on the fact that 



(/(«) - ^, Wli/ifn (/)W) 4 < (/(«) 

as soon as osc(/) < 1. This ends the proof of the lemma. 



Combining this lemma with (|33p . we prove that 



1 



1 1 

iV m 



and 



This implies that 



p=0 



t-p — 1 ,tp \ Lp 



E 



1 1 

iV m 



(m,7V), 



1 1/4 



and therefore 



E(^(/) 2 )<c, n (/) (1 + m/JV). 
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Using the fact that 




we conclude that 

n e (( M f„(/) - ,t\f)) 2 ) < «.(/) (i + jf + ^) • 

This ends the proof of theorem 13.21 ■ 



6.2 Discrete time models 

The main objective of this section is to prove theorem 13.21 for the discrete time models related to case 
(D). In this situation, we recall that Ht„ m = Vn, for any integer parameter n £ N. As usual, the 
approximation measures pL^ n are defined as the occupation measures of the mean field particle model 
of the McKean distribution flow fj,^ . By lemma 15.31 for any k S N we have 



L 



(m) 



k— — ,U, 



IC, 



Id = S k _i ^h-Id 



and for any (k — l)m < p < km, with k £ N, we have 



M 



tp— 1 



Id 



L 



(m) 



When the Markov transport equation ([5]) is met for some Markov transitions 5f niA1 satisfying the first 
order decomposition ©, we have for any k G N and any (/c — l)m < p < km 



L 



(m) 



' = T — I- 7? 



Using the same line of argument as in (|32p . we prove that 



e(w£_ iA ,(/) 2 I 6 



.JV 



/'f 



p-i 



^tp-i 



r i( m) 

tp-l.M, 



(/,/) 



p-1 



L l m V (/) 



/. , AT 



(/,/) 



p-1 



1 ^AT 1 



m 



+ ^p-i (/) 
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with some remainder term R^ } _ 1 (f) such that 

sup <_,(/) <c pt^W 2 osc(/) 2 . 

N>1 

This clearly implies that 

E (W^_ 1)tp (/) 2 | &„) < c ||W tp _i || 2 osc(/) 2 I and E (w£i >fc (/) 2 | £ fc __i) < osc(/) 2 . (34) 
As in proposition 16,11 we prove the following decomposition. 

Proposition 6.3 For any N > 1, / £ Bb(E), and any iieNw /iat>e t/ie decomposition 

\rf - Vn ](f) = A% + 2# 



with 



(k-l)m+(m-l) 

a n ._ 1 t^jv (n {m ' N) (f) 

l<fc<n p=(fc-l)m+l A'tp l^tp.n 



and 



0<fc<n Mfe l^fc.n 



/n £/ie above, the function G^'^ and the integral operator D^ 1 ^ (/) are defined in proposition \6.1 



and /or A; = 0, ioe /tawe used f/ie convention W N - L = Wq . 



To analyze the bias and the variance, we also need to consider the first order decompositions 
presented in the following corollary. 

Corollary 6.4 For any N > 1 and any n € N we have the decomposition 

A» = A^ + -LA(»» and ^ = flW) + -L B^ a ) 
uffli/i i/ie /irsi order terms 

(fc-l)m+(m— 1) 

4^ = E E 

l<fc<n p=(fc-l)m+l 

^ = E ^^(t^/) 

0<fc<n 

and i/ie remainder second order terms 

(fc-l)m+(m-l) 

^n Af ' 2) = E E ^ 7=KiV)\ ^-l.tp } ) ^V-i.tp (-°i,n } (/)) 

l<fc<n p=(fc-l)m+l Mtp (^%,n J 



0<k<nHk \ Lr k,n 
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Now we come to the proof of the bias and the variance estimates presented in theorem 13.21 
In the further development of this section / stands for some bounded function s.t. osc(/) < 1. 
By construction, the random fields W^_ 1 1 and W^_ t t are uncorrelated for any p ^ q. Combining 
this property with the estimates (|34|) we prove that 



On the other hand, we have 



(fc— l)m+(m— 1) 

E E « 

l<fc<n p=(fe-l)m+l 



(m,N) l 



E 



tp—\.tp \ tp^n 



D 



(m,N) 



(f))\ )^ [€,l>™[ p Cn(f) 



}( m ), 



with 



(m) 

%,n := sup 

x,y 



We prove the last assertion using the fact that 



osc(^(/))/2< D%f\f) <4So8c(p£2(/)). 
By the semigroup formulae ([9|), for any p = (k — l)m + r, with r < m we find that 

'G fe -i(*)V /m 



with 



D (m) D , (m) , / C fe _i(x)\ 

P tp,n = -P(fc-i),n and g\ p ^ < g k _ 1)Tl x sup I — I 

5fe-i,n == sup [Q(fc_i),„(l)(x)/Q(fc_i),„(l)(2/)] ■ 



l/m 

0fc-l,n X 5fc_i,fc 



This implies that 



E^f' 1 ))*) <c ]T pogGfe^f (^-i,nX^ / _7 )fe osc(P (fe _ 1))n (/) 



In the same way, we prove that 



0<fe<n 

< c 



E ■([' 



(m,iV) 



E [ffff""^)] = c E bM0sc(P fc , n (/))] 2 . 



0<fc<n 



0<fc<n 
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On the other hand, we have 



E ( 



(fe-l)m+(m-l) 



< 9k~l,n9k™,k Yl 

p=(k—l)m+l 



Kk<n 



-^(_m,N) 



1/2 



El IW. N ♦ (D {m > N) 



tp—i^tp \ tp^n 



(/) 



< E ll l0 g G fcl| 2 (9k,n9k,k+l) 3 OSc(Pfc in (/)). 



0<k<n 

Arguing as in the end of the proof of theorem 13.21 we can also check that 



< 



Kk<n 



(fc-l)m+(m-l) 



9k~i 



p=(k— l)m+l 



(fc-l)m+(m-l) 



< £ 9k-i, n gl™ ltk £ 

p=(k— l)m+l 



l<fc<n 

On the other hand, using lemma RT21 we have 
E 



1/4 



^m,N)\\ 4 \ ■ w l(„ rN fr,(m,N). 



w t N lt fcS m f )N " 



< * (2</£>) 2 E 



f-p—i i^p i tpjit 



+ 6 E 



from which we find the crude upper bound 



E 



^ 4 4 

- c 9k-l,n9k-l,k 



logGfc-ill VI) 4 /™ 2 
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for any N >m, and for any p = (k— l)m + r, with r < m. Using the same line of arguments, we have 



E 



IT', 



<± (2^osc(P^(/)jj El W-_ utp {D^>(f) 



,(m) 



-N 



Jm,N), 



+ 6 E 



(m,N) 



< c gt-^gtl, osc (P (fe - 1)in (/)r (|| logGfc-iH v l) 4 / 

for any N > m. This implies that 

1/2 



4 / 2 



E (4^) ) <c Y, ^-i,nSfc-i,fc(l|logG? fc _i|| Vl) 2 osc(P (fc _ 1)in (/)) 

Kfc<n 



for any N > m. One concludes that 

E ((^) 2 ) < c (a ltn + i a|J < c a 2 , n + 1 a 2 J 



with 



and 



,n9k,k+l OSc(P fejn (/))) < 

0<fc<n. 

a 2 ,n:= E 5fc,n5fc,fe+i(IUogG fc || V l) 2 osc (P M (/)). 

0<fc<n 



In much the same way, we prove that 



Using the fact that 
and 



1/2 



0<fc<n 



E 



m ' v 



4\ V4 



E 



1/4 



E 



* (^TV)) ) < c <7iU osc(P M (/)) 



,(m,iV). 



we check that 

0<fc<n 

< C E 5fc,n OSc(P fe , n (/)). 



1/2 



E 



2 y/2 



(36) 



0<fe<n 
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Combining (|35p with (|36j) . we obtain the bias estimate 
N \E(^(f))- Vn (f)\ 

< c Eo<fe<n Sk,n osc ( P k,n{f)) + Yl ll lo g G fcl| 2 (9k,n9k,k+lf osc ( P k,n(f)) 
\ 0<k<n 

< c (H lo g G fcll V (9k,n9k,k+l) 3 OSC ( P k,n(f))- 

0<k<n 

In addition, we have that 



E 



< c 



9k,n 



E 



+ E 



K-±k (GkT' 



and 



E 



< c 



9k,n 

N 



osc(P M (/)) 2 E [Wl^ k «/ } (/))] +E (^(/) 



^ C 5fc, n OSC (Pfe, n (/)) 4 

This implies that 



We conclude that 



^< 2) ) 2 ) <C £ fli,„ 08C (J\, B (/)) . 
' 0<fc<n 

E ({B* f) < c (b ltn + i 62 ^ < c ft 2 n + _L &2 ^ 



with 



&l,n := ^ [9k,n osc (P k:n (f))] 2 <b 2i n < a 2 , n and 6 2 ,n := ^ fffc, re osc i p k,n(f)) 



0<k<n 

This yields the variance estimate 



0<fc<n 



N E ((^ (/) - r^/)) 2 ) < c a 2 , n (l + 1 a 2 , re J . 
This ends the proof of the theorem. 
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7 Appendix 

7.1 Proof of theorem 13.11 

We let r and r be the mappings on M + denned by 

^( s ) = 2 1 [*n,in+i[( s ) *n and r(s) = ^ l[t„A+i[( s ) *n+l- 
n>0 n>0 

With this notation, we clearly have that 

ftn ftp+1 

/ V z{s) (X z{s) )ds = £ / V 2:W (^ w )d a = ^ Vt p (^ p )/m. 

, ' 0<p<n. *P 0<p<n 

In case (D) we readily check that 7m = vu \ , for any i E R + . More precisely, we have 
n = km + r with /c>0, < r < to ==>■ t n = k + r/m 
and the pair of processes (V s , X s ) only change at integer times, that is we have that 
t pm =p< s < t(p+i) m = (p + 1) V s = log G p and Af s = X p 
so that for any q £ N we have that 

t g < s < tg+i => V s = V tq and X s = X tq . 
Furthermore, using the fact that 



/ V s {X s )ds= V tp (X tp )/m 

0<p<n 



we readily check that 



^„(/)=E if(X tn ) H e V* P (^)/- v tnm =ln and Mw = r, n . 

\ 0<p<n J 

Now we come to the case (C). We have the Ito formula 

dVt(X t ) = (J^ + LA (V t )(X t ) + dM t (V) 
with a martingale term Mf(V) with predictable angle bracket 

d(M(v))t = r Lt (Vt,v t )(x t )dt 

defined in terms of the carre du champ Yi t operator associated with the generator Lt and defined for 
any / S D(L) by the following formula 

T Lt (f, f)(x) = L t ((f - f(x)) 2 )(x) = L t {f)(x) - 2/(x)L t (/)(x). 
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We recall that the predictable process (M(V))t is the unique right-continuous and increasing predictable 
such that the random process Mf(V) 2 — (M(V))t is again a martingale. We also recall that Mf(V) 2 — 
[M(V)L is also a martingale, for the quadratic variation [M(V)] of the process M(V) defined as 



IMHo fc=1 

where tt ranges over partitions of the interval [0,t], and the norm ||7r|| of the partition tt is the size of 
the mesh. For continuous martingales Mt(V), it is well known that [M(V)] = (M(V)). 
Using an elementary integration by part formula, for any p > we have 



tp+i 



(V.(X.) - V tp {X tp j) ds = I + \t p+l - s) dV s (X s ) 

J tn 



from which we conclude that 







We set 



V s (X s )ds = / V z(s) (X z{s) )ds + / (r(s) - s) dV s (X s ). 



X" V s (X a )ds _ /„«» V iW (^. w )d. 



Using the fact that \e x — e y \ < \x — y\ \e x + e y \, we prove that 



|^„(/)| <E 



(r(s) - s) dV s {X s ) 



J* n V s {X s )ds + e ti" V l(s) (*, (a) )d s 



Using Holder's inequality we have 



|iU/)|<E 



(r(s) - s) dV s (X s 



E 



/ *» V,(X.)ds + e /* n V z{8) (X^ s) )ds 



W 



To estimate the first term in the r.h.s. of the above estimate, we use the inequality 



E 



f^(r(s)-s)dV s (X s ) 



< E 



Jo(t(s)-s) + L s ) (V s )(X s )ds 



p\ i/p 



+ E 



C(t(s)-s) dM s (V) 



p\ 1 /p 



Using the generalized Minkowski inequality we prove that 



E 



loin*)'*) (g + L s )(V s )(X s )ds 



p\ i/p 



<lt(r(s)-s)E([(-§- s +L s ) (V s )(X s )y 



i/p 



ds 



<i ft®m + Ls)(V s )(X s )] p ) ds. 



1/p 
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On the other hand, by the Burkholder-Davis-Gundy inequality, for any p > we have that 



E 



{T(s)-s) dM s (V) 



< c p E 



tn TP/2\ 1/P 

(r(s)- S ) 2 d[M(V)] s 







^E([M(V)]^ 



Cp 

m 



i/p 



J 



for some finite constant c p < oo whose values only depends on the parameter p. The end of the proof 
of the first assertion. The second one is proved using the decomposition 



(/) 



1 



Al m) (l) 



AL m) (/») - A t „ (/„) 



with the centered function f n = (f~ ^-t„(f))- 

2 

< 



From these estimates, we find that 



sup 



a£°(1) VAJl) f€B b (E n )--. ||/||<1 



a£° (/) - K (/) 



< 



ltT -A^(l)VMl) 



l n II tv 



and 



with for any - + ^ = 1 



m>l x 



b (p') = E (>'/o V S (*)^ W v E (>'/o W^.))*) 



< OO 



as well as 



IE 



-i p\ l/p 



Whenever V G C 1 ([0,oo[,P(L)), we have 



^ — ex P ( * SU P ||V S || ) and c K t P> < t sup 
0<s<t J 0<s<t 



ds < oo and 



4 P) :=E([M(V)]f) 



i/p 



< oo. 



9s 



+ L s (V s ) 



(p) 

Notice that for stochastic processes with continuous paths, the constant d t is given by 



d? := E ( <M(V)>? /2 



i/p 



E 



T La (V a ,Vs)(Xs)ds 



p/2\ Vp 



< Vt sup ||r Ls (v„v s )|| 1/2 . 

0<s<i 



This ends the proof of the theorem. 
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7.2 Proof of proposition [5731 

In case (D), the mutation transition only occurs at integer times. More formally, we have Xt n = Xu 
so that for any 

n = km + r with r + 1 < m 

we have 

t n = k + r/m => M tn ,t n+1 (y,dz) = ■Mk+r/m,k+(r+i)/ m (y,dz) = 5 y {dz). 
On the other hand, we have that 

n = km + m — 1 => t n = (k + 1) — 1/m with t n+ i = (k + 1) 



and 



M tn ,t n+1 (y,dz) = M( k+1 yx/ mt ( k+1) (y,dz) = M k+1 (y,dz). 
This ends the proof of the first assertion. Now, we come to the proof of (|24p . Firstly, we recall that 

f(t n+1 ,X tn+1 ) = f(t n ,X tn ) + J' n+1 (J- + L s ^j (f)(s,X s ) ds + M tn+1 (f) - M tn (f) 

for any / € C 1 ([f n , t n +i]> D(L)), with some martingale Mt(f). This implies that 



rtn+i 

E tntX (f(t n+1 ,X tn+1 ))=f(t n ,x)+ \ 



§- s +L s 



ds 



where Ef n)X (.) stands for the conditional expectation operator given that Xt n = x. Iterating this 
formula, we find that 



E 



t n ,X 



A+L tB V/)( tn>X )+ r E tn , 

fir J J t n 



lfr +Lr 



dr 



as soon as (Jj + Lt) (/) £ C 1 ([t n , D(L)). Under this condition, we find the first order decompo- 



sition 



E tn>x (f( tn+1 ,X tn+1 ))=f(t n ,x)+(^-+L tn ) (f)( tn ,x) ±-+R tn (f) "4 

\ U^Tl J Til) lib 



with some remainder operator 

RtM) = m 2 

such that 



tn+l 



d_ 
dr 



+ L r ) (f)(r,X r ) 



dr 



\Rt n (f)\\ < su p su p 

X£Etn<t<t n+ l 



3i 



+ L t (/)(t,Xt 



The end of the proof of (|24p is now clear. Using lemma 15.21 and the first order decompositions ((3 
and (1241) we have 



L t™i ~ — + Rt r , 



1 



1 

m z 
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with 



R 



Rt n + Rtn^ + m 



m 



+ R 



Lt„ \-Rt„ 



m 



On the other hand, we have the estimates 



m 



T I + f? ± 

m m z 



Ltn \-Rt„ 



m 



m- 







— Ltn,n 


Lt n + Rt„ — 




m 



+ Rt n ,^ tn 



with 



and 



Rt„,n L ™ (f) 



<c tn 







(/) 






L t n + Rt n — 


< Ct 




m 







L tn (f) + RtJf) 



rn 



< c tn sup (||^(/)/5t|| + ||L 4 (/)|| + ||L t 2 (/ )||) 

t n <t<t n +\ 



for some finite constant cj n < oo. This ends the proof of (I25D . 
The proof of the last assertion is based on the decomposition 



([/ - ^Wn+U/X*)] 2 ) (*) = r>) (/, - (L^(/)(x))' 



and the fact that 



1 _ „. „ 2 v,, 1 



i>o (/, /)(*) = r itniM (/, f)( x ) - + R tn ^ ((/ - f{x)f) (x) —. 



This ends the proof of the proposition. 



7.3 Proof of the first order decompositions ((6]) 



Case 1 : We assume that Vt = —tit, for some non negative and bounded function Uf In this 
situation, ([5|) is satisfied by the Markov transition 

S tnA:) {x,dy) := e -^(*)A» 5x {dy) + (l - e ~ u ^ m ) * e - Wtn/m (^)(dy). 



In this situation, we notice that 



5, rm)(/)(x)-/(x) 



/ (/(*)-/(*)) ^r } (^) + o(i) = 2 t r»)(/) + o(i). 
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Much more is true; if we set 



R t „(*»)(/) : = m 



s t <Mf)-f 



m ( 1 — e 



-Ut n /m 



then we find that 



R t „(")(/) 



< m\m (1 - e -"W™) - Z^J x | ^^O^X/) " / 
Using the fact that 



??? 



Ml m 



-Utn/m 



we prove the following first order expansion 



S f ,,(™)(/) - / = L ,.(«)(/) — + R f ,.(m)(/) — 2 



(37) 



with some integral operator i? ( m) such that 



sup 

m>l 



(/) 



<c ||^J| 2 osc(/). 



Case 2 : We assume that Vt is a positive and bounded function. In this situation, ([5]) is satisfied 
by the Markov transition 



S (m) (x,dy) := —— - - 
In this situation, we notice that 



S x (dy) + 1 



/4 m) (e V *«/ m )/ -l)^*n A if J 



S t < m) (f)(x)-f(x) 



m 1 



* (e v tn/m _ 1) ( / i t ( : ) )(/)-/(x) 



(/(*)-/(*)) Vt„(y) /^(dyJ + OU). 



Using some elementary calculations, we also prove a first order expansion of the same form as in 
(EH). 
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Case 3: The Markov transport equation ([5]) is satisfied by the transitions 

/ ^ m) (( e V tn/™- e V t „M/™) )\ 

S {m) (x,dy) := 1 2-5> — (m) ±^ ^(dy) 



+ - 



•) + ) 



* ( e V t „ /™_ e V tn (*)/™) (/^ ) iAy) ■ 



M ( e V tn /m) 



The above Markov transition is well defined since we have 

,H ((pVtn/m _ p V tn {x)/r 



ff(( e V,/ m - e V,WM) l Vtn> y t „ W ) 



< 1 



as soon as 



Also notice that 



/4 m) I fe Vt " /m - e Vt ^ x)/m 



so that a particle in some state x is more likely to be recycled when the potential values Vt n {%t n ] 
of random states Xt n with law fj,^ are more likely to be larger that Vt n (x). 
Finally, for bounded potential functions we observe that 



m 



S t < m) (f)(x)-f(x) 



ML 



("0 ( (pVtn/m _ p Vt n (x)/i 



m 



/ 



+ ) 



( e V tn /m._ e V tn {_x)/ m \ 



[/GO " /(*)] (Vt„(y) - V tn (x)) + /^(dy) + O(l). 



Using some elementary calculations, we also prove a first order expansion of the same form as in 
(EH). 
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